Group Codes for the Gaussian Channel 

By DAVID SLEPIAN 

I (Maniiseripf received April 27, 1967) 

' A class of codes for use on the Gaussian channel, called group codes, 
is defined and investigated. Roughly speaking, all words in a group code 
are on an equal footing: each has the same error prdbahility and the same 
disposition of neighbors. A decomposition theorem shows every group code 
to be equivalent to a direct sum of certain basic group codes generated 
by real-irreducible representations of a finite group associated with the 
code. Some theorems on distances between words in group codes are demon- 
strated. The difficult problem of finding group codes with large nearest 
neighbor distance is discussed in detail. 

I. INTRODUCTION 

In a communication model first introduced by Kotel'mkov^ in 1947, 
and independently by Shannon^ in 1948, and since studied by many 
authors,^"^^ messages for transmission are represented by vectors in 
a Euclidean space, S„ , of ti dimensions called signal space. In this 
model, known as the Gaussian channel, when X is transmitted, the 
received signal is represented by a vector Z = X + Y which consists 
of the sum of the sent vector and a noise vector Y whose components 
are independent Gaussian variates with mean zero and variance o■^ 
Some physical circumstances that lead to this model, as well as further 
details, can be found in Refs. 3, 10, and 13. 

An equal-energy block code of size M for use on this Gaussian channel 
is a collection of M distinct vectors X, , Xa , • ■ ■ , X^ in signal space 
all of the same length. We shall always suppose M ^ n and that the 
vectors span S„ . The length of the vectors serves to define an important 
parameter S called the average power of the code through the equation 

nS = \X,\\ (1) 

The vectors of the code are called code words or code points. Their 
termini lie on the sphere of radius VnS centered at the origin of S„ . 
Associated with each code point X,- of an equal-energy block code 
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is a region CR, of signal space called a maximum likelihood region and 
defined by 



(H. = iX 



X - X, 1 g 1 X - X, \,j^i>- (2) 



That is, (Ri is the set of all points in S„ at least as close to X,- as to any 
other code word. These regions are convex flat-sided cones with apex 
at the origin. The interiors of <R, and (R/ are disjomt for i ^ j: the 
union of the (R^ is all of S„ . 

The capabilities of equal energy block codes for communicating over 
the Gaussian channel are well known. If the words of a code are presented 
equally likely and independently for transmission over the channel, 
the communication rate is 

R =-\ogM (3) 

n 

natural xmits per second where a (measured in numbers per second) 
is the rate at which vector components are transmitted. The receiver 
which minimizes the average error probability^ '^^ operates by asserting 
that code word X,- was transmitted when the received vector Z lies 
in (Ri , i = 1, 2, ■ ■ ■ , M. (The received vector Ues in the boundary 
of some (R. with probability 0.) When Xj was transmitted the error 
probability of this best receiver is 

where Sl'i is the complement of (R, . The average error probability is 

Upper and lower bounds are known*'"'^'"" for P.^in(M, n, S), the 
smallest attainable value of P, for an equal-energy block code with 
the indicated parameters. In the limit as n -* «=, these bounds lead 
to the famous capacity formula C = a/2 log (1 + S/a^) whose in- 
terpretation we suppose known. For fixed finite values of M and n, 
however, little is known in the general case about codes for which 
P, attains its minimal value (optimal codes). The cases M = ?i -\- 1, 
n + 2, ■ ■ ■ , 2n have been studied in some detail.*'^'^* For n = 2, 
Weber'* showed that the regular il/-gon is globally optimal: for M = 
jj ^ 1^ 71 = 2, 3, ■ ■ ■ , it has been shown^" that the regular simplex 
is optimal. No other optimal codes with n > 3 are known. 

■ t 
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Recently Wyner^^ has investigated the capabilities of equal-energy 
block codes when a suboptimal receiver, known as a bounded distance 
decoder, is used. Here the regions (Ri of the maximum liltelihood receiver 
are replaced by spheres of radius d/2 centered on the termini of the 
code vectors X,- , where d is the minimum distance between any two 
words of the code. If the received vector is not in one of these spheres, 
a decoding error is assumed. Wyner established upper and lower bounds 
on the smallest en'or probability attainable with an equal-energy block 
code using bounded distance decoding. In the limit as n —^ <x> he ob- 
tained coding theorems and a capacity analogous to the usual ones. 
For finite M and n, the error probability using bounded distance 
decoding is a monotone decreasing function of the minimum distance d 
between code words of an equal-energy block code. In the general case 
little is known about equal-energy block codes with largest nearest 
neighbor distance. 

For equal energy block codes of il/ vectors spanning S„ two optimiza- 
tion problems thus present themselves : to find a code for which P^ , 
as given by (4) and (5), is a minimum; and to find a code with largest 
nearest neighbor distance between its code words. We have made little 
progress in solving these problems. 

In this paper we investigate instead a class of equal-energy block 
codes called group codes. It is conjectured that this class includes 
solutions to the problems just mentioned for many values of M and n. 
Quite apart from these questions of optimality, however, group codes 
possess an important symmetry property that malces their study of 
interest in its own right. Roughly spealdng, all code words in a group 
code are on an equal footing. Tliis notion is made precise in the next 
section. 

Most codes that have been investigated for the Gaussian channel 
are group codes; it is likely that any code used in practice will be of 
this type. Group codes for the Gaussian channel are a natural exten- 
sion of the group codes introduced for the binary channel in Ref. 21, 
and these latter codes are obtained as a special case of the codes de- 
scribed here. 

In what follows, we define equivalence for group codes, then in- 
vestigate the possible classes of group codes. Here the theory of group 
representations plays a key role.*'^ The appendix gives a summary 
of results needed from this field. The problem of constructing group 
codes is considered and an optimization problem of some difficulty 
is encountered. A number of interesting properties of group codes are 
di.s closed. 
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Many of the results reported here are contained in the author's 
Bell Telephone Laboratories report of May 7, 1951, a document that 
received a limited circulation outside the Laboratories. A number of 
these results were recently rediscovered independently by J. G. Dunn 
and appear in his thesis^^ along with extensions in directions different 
from those reported here. The discovery of an easy decoding algorithm 
for certain group codes^* has led to a revival of the author's interest 
in this subject, and so the present paper, while in part very old, is a 
report on research now in progress. It examines the general structure 
of group codes. In a later paper we hope to give a detailed treatment 
of some group codes associated with the symmetric group. 

H. GROUP CODES 

In studying the geometric properties of equal-energy block codes, 
it is convenient to deal only with code vectors of unit length. That is, 
we set S in equation 1 equal to 1/n, and deal with normahzed codes. 
To compute error probabilities associated with the use of the code, 
one must scale up the vectors by a factor VnS- 

Let X] , Xa , ■ ■ • , Xjir be the (unit) vectors of an equal-energy block 
code. It is clear from the definition of the regions (R,- and from (4) 
and (5) that P, is invariant under a rotation of the code as a whole. 
That is, if is an arbitrary n X n orthogonal matrix and 

XJ = OX, , i= 1,2, ■•• ,M, (6) 

the error probability P; for the code XJ , • • • , X^^ is the same as that 
for the code Xi , X2 , - ■ • Xju- . The set of interword distances for the two 
codes is the same, and in particular both codes have the same minimum 
nearest neighbor distance d. Two codes whose vectors (with possible 
renumbering) can be related as in equation (6) are called equivalent 
Equivalent codes have the same communication capabilities. 

We now examine in what sense the words of an equal-energy block 
code in S„ might be "alilce". Given the M unit vectors X,- that define 
the code, the real orthogonal n by n matrix is said to leave the code 
invariant if the Y,- are a permutation of the X,- where Y,- = OXj , i = 
1, 2, • • • , M. The collection = { Oi , O2 , ■ ■ • , J of all real orthogonal 
n by n matrices that leave the code invariant clearly forms a finite* 
group under ordinary matrix multiplication. Now transformation by 



* By hypothesis, the X,- span S„ . An n X n orthogonal matrbt is completely 
determined by its effect on a set of n vectors that span its carrier space. Since the 
words of the code are pennnted along themselves by each element of ff, ff ^ M!. 
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an orthogonal matrix preserves distances between points, so that a 
possible definition of "alikeness" for the points of the code is to require 
that in the group 6 there be elements Oi , Oa , ■ ■ • , Om that transform 
any particular word, say X^ , into each of the M vectors of the code. 
A collection of M unit vectors spamiing S„ that satisfies this condition 
will be called a group code and denoted by the sjonbol [M, n\. In a 
group code, if 0, sends Xi into X, and 0, sends Xi into X, , then 0,07' 
sends Xj into Xj . We have then 

Proposition 1: For a group code, the set of distances from X, to all 
other points oj the code is the same as the set o/ distances jrom X,' to all 
other points of the code, i, j = 1, 2, • ■ • , M. 

Each point has the same number of nearest neighbors, the same number 
of next nearest neighbors, and so on. 

The maximum likelihood regions (R^ for a code are defined by equa- 
tion (2) in terms of distances from code points. Since orthogonal matrices 
leave distances invariant, it follows that for a group code a matrix 
t B that sends X, into X, also sends 61, into (R,- . From this fact and 
the form of (4) we have 

Proposition S: For a group code [M, n ] the maximum likelihood regions 
ffti , 0^2 , ■ • • , <R^f are all congruent and all words have the same error 
prohahility, that is, P.i = P.^ = ■ ■ ■ = P,„ = P, . 

III. GENERATIOX AND CLASSIFICATION OF GROUP CODES 

To each matrix of the group $ of orthogonal matrices that leaves 
a group code {M, n] invariant, there corresponds a permutation on 
M letters, namely the permutation effected by on the M vectors 
of the code. That these permutations form a transitive permutation 
group follows from the definition of a group code. No two different 
elements of 8 can effect the same permutation of the words of { M, n \ 
since the effect of an n X n matiix on a set of vectors spanning S, 
completely determines the matrix. We have then 

Proposition S: The group 6 oj all orthogonal n X n matrices leaving 

a group code \M, n\ invariant jonns a faifhfid representation oj {is simply 
isomorphic to) a transitive permutation group on M letters. 

Group codes [M, n] do not exist for everj' AI and n. For example, 
it is not hard to prove that it is impossible to arrange 5 points on the 
sphere in 3 dimensions to form a group code. Necessary and sufficient 
conditions on 71/ and n for the existence of an {M, n] are not known. 
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Group codes do exist in great abundance, however, and we shall 
give examples later. Indeed, from any set o? n X n orthogonal matrices 
Oi,02, ••■ ,0m that form a finite group g under matrix multiplication 
we can form a group code by choosing a unit n-vector X and forming 
the set of vectors 

X, - O.X, i= 1,2, ■■■ ,M. (7) 

Elements of g leave this configuration of vectors invariant by the 
group property. Since g must contain the n X n unit matrix, X is 
among the collection of vectors and it is sent into each of the other 
vectors. A group code therefore results. This code may not have Af 
distinct vectors, however, and it may not span S^ . The code depends 
on the initial vector X. 

If the code has fewer than M vectors, tlieu for some i 7^ j, X, - X, 
or 0.x = 0,-X, or O^'O.X = O^X = X for some Ot t g. That is, X must 
be an eigenvector ^ith eigenvalue unity for at least one c g different 
from the unit matrix. The set of all such e g forms the subgroup 3C 
of order /t of g that sends X into itself. It is easy to show that by (7) 
g generates y = M/h distinct vectors. Since the matrices of g have 
only a finite number of eigenvectors, however, it is always possible 
to choose an X so that the M vectors (7) are distinct. 

It may not be possible, however, to choose X so that the vectors 
span S„ . To discuss this matter further we must recall the notion of 
real-reducibility. A finite group of (real) orthogonal matrices g = 
Oi, O2, ■•• , Oif is said to be real-reducible if there exists an n X n 
real orthogonal matrix such that for i = 1, 2, ■ ■ • , M 



00,0-' = i^ 



f) 



where .d,' is an Z by ^ matrix, B.i&oxin — Ihy n — I matrix, Q <l <n 
and C and D are matrices all of whose elements are zero. It is assumed 
that / does not depend on i. A group of real'orthogonal matrices that 
is not real-reducible is said to be real-irreducible. In words, a real- 
reducible collection of matrices can be simultaneously transformed to 
block diagonal form by a real orthogonal matrix: a real-irreducible 
collection cannot be so reduced.* The reduced matrix in block form 
in equation (8) is said to be the direct sum of the two square matrices 
Ai and B,- . 

* In the theory of group representations (see the appendix) reducibility is usually 
defined over the Held of complex numbers. The definition is as above with O replaced 
by a unitary matrix. We shall speak simply of "reducibility" in this case as opposed 
to "real-reducibility". 
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It is easy to show that if the matrices O,- of equation (7) are real- 
irreducible, then the code they generate spans S„ for all choices of X: 
if they are real-reducible, for some choices of X the code will not span S„ . 

These comments lead to 



M 



Proposition 4- Every real-irreducible group S = Oi , O2 , ■ ■ - , 0„ 
0/ real orthogonal n X n matrices serves by means of equation (7) to generate 
a group code {M', n\ jar each unit vector X in S„ . Here M' ^ M. If 
M' < M, it is a divisor of M. 

Propositions 3 and 4, together with the theory of group representa- 
tionsf suggest a means of classifying and generating all group codes. 
From Proposition 3 we can associate mth a given group code [M, n\ 
a unique abstract group and a faithful representation 6 of this group 
by orthogonal matrices. The code can be thought of as generated from 
one of its vectors, X, say, by the operation of the matrices of this 
representation in the manner of equation (7). Now the representation 
d will in general be real-reducible. There \vill exist then a real orthogonal 
matrix that will exhibit 6 in block form (S) as the direct sum of a 
number of real-irreducible representations. Denote this new reduced 
representation by 6'. It is easily seen that the matrices of 6' operating 
on the vector Y = OX generate a group code Y, , Y2 , • ,Ym equivalent 
to the originally given \M, n\. We can further regard Y as the sum 
of its projections Y\ Y", • • ■ on the various invariant subspaces of 
B' indicated by its block structure. 

By the procedure just outhned, for each equivalence class of group 
codes we anive at a particular set of real-irreducible representations, 
say 01 , 03 , • • • , 0, of an abstract group, each with a corresponding 
associated vector Y', Y^ ■ ■ ■ , Y'. We regard Y' as lying in the can-ier 
space of di , so that if 6. is of dimension U , then Y' is a vector of It 
components, i = 1, 2, • ■ ■ , j. Let the length of Y* be X.- . We have 
51^ Xv = 1. The 8i are determined by {M, n} only up to equivalence 
in the sense of representation theory, owing to the possibihty of reduc- 
tion of 6 by different matrices 0. The vectors Y' inherit some additional 
freedom owing to the M possible choices of X in the preceding paragraph. 

We can think of the {M, n} as decomposed by the above process into 
an equivalent duect sum of j group codes, the zth code being generated 
by the matrices of 6i operating on the initial unit vector Z' = Y'/X.- , 
i = 1, 2, • ■ ■ , j. The constituent group codes are weighted by the 
numbers Xi , X2 , • • ■ , X/ in forming the direct sum code [M, n]. Notice 

t Knowledge of the material in the appendix is necessary for understanding 
much of the remainder of this paper. 



582 THE BELL SYSTEM TECHNICAL JOTIHNAL, APRIL 1968 

that some of the constituent codes may have fewer than M distinct 
words. 

Conversely, within equivalence we can construct any group code 
as the weighted direct sum of codes generated by real-irreducible groups 
of matrices after the manner of Proposition 4. In synthesizing codes 
in this manner, we may, of course, arrive at equivalent codes by several 
different consti'uctions. The gioup g of Proposition 4 may be only a 
subgroup of the group of all orthogonal transformations that leave 
the code generated by g invariant. Different initial vectors operated 
on by the same gi'oup of matrices may give rise to equivalent codes. 

Every group possesses the trivial real-irreducible one-dimensional 
identity representation in which each group element is represented by 
the one-dimensional unit matrix. The inclusion of this identity rep- 
resentation in the constituent codes making up a direct sum code 
represents a waste of one dimension, since the code is then equivalent 
to one in which each code vector has the same first component. This 
first component then carries no information. By omitting the first 
component of each vector (and rescahng the length of the resultant 
vectors), a new code of dimension n — 1 is obtained with error prob- 
ability no greater than the original {M, n]. In general in what follows 
we will not be concerned with codes that contain this identity rep- 
resentation. 

We turn our attention now to the basic problem of constructing good 
group codes as the weighted sum of properly chosen group codes gen- 
erated by real-irreducible groups of orthogonal matrices. 

IV. THE INITIAL VECTOR PROBLEM AND THE FUNDAMENTAL REGION 

As in Proposition 4, let a code be constructed from a given group 
g = Oi , O2 , ■ • • , Om of orthogonal n X n matrices by means of equa^ 
tion (7). We thinlc of these matrices as a faithful representation of an 
abstract group isomorphic to the matrix group. The code obtained in 
tills manner depends upon the initial X on which the matrices operate. 
The regions (Ri of equation (2) and hence also P. = P^ by (4) also 
depend on this choice. We suppose now that X is not an eigenvector 
of any of the 0,- so that the code has M distinct words. It would be 
desirable to be able to choose an X of this sort to either minimize P, 
or to maximize d, the nearest neighbor distance. We have not seen 
how to solve either of these problems in general. A few words about 
them are in order. 

Consider first the problem of choosing X to maximize d. The squared 
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distance between X and X; is 

d\X, X,) - I X - X, |- = 2 - 2X-0,X 

a monotone decreasing function of the quadratic form X-O.X in the 
components of X. This form is the cosine of the angle between X and X,- . 
Solution of the maximum nearest neighbor distance is equivalent to 
finding 

a = min max XO.X (9) 

where the maximization over the matrices of 9 must omit the identity 
matrix. The quantity a is an invariant of the representation (is the 
same for every equivalent representation) and should ultimately be 
expressible in terms of properties of the group. The vector X which 
minimizes (9) is not unique : any word in the code generated by X would 
serve as well. 

Given 5, we define two points X and Y on the unit sphere to be equiv- 
alent if one can be obtained from the other by an operation of 9. The 
surface of the sphere is thus divided into equivalence sets. A connected 
region on the sphere such that no two points in its interior are equiv- 
alent and such that every point on the sphere is equivalent to some 
point in the region will be called a fundamental region of 9, The maxi- 
mum Hkelihood regions, (3i, , associated with any {M, n] generated 
by 9 intersect the unit sphere in fundamental regions. These inter- 
sections are very special fundamental regions: they are convex and 
bounded by hyperplanes. 

In attempting to minimize P, or maximize d it clearly suffices to 
consider initial vectors X restricted to some fundamental region. It 
is natural then to ask what fundamental regions are possible for a 
given 9. 

The situation is complicated. For some groups, the fundamental 
region is completely determined (up to equivalence under the group 
operations, of course): for other groups only certain features of its 
boundaries are determined, or no points at all may be determined. 

For example, in the plane consider the group 9i generated by the 
three matrices corresponding to reflections in three lines through the 
origin that make angles of 60° with each other. This group is of order 6 
and is a subgroup of the symmetry group of a regular hexagon having 
the given lines as diagonals. The fundamental region of this group is 
completely determined. It is a 60° arc of the unit circle with end points 
on two of the given lines. Any group code {6, 2} generated by g, has 
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this fundamental region for the intersection of one of its maximum like- 
lihood regions CR^ with the cu'cle. Choice of X serves only to position 
the initial vector within the maximum likelihood region. (When X is 
chosen to lie on one of the reflection lines, a {3, 2} results and the maxi- 
mum likelihood region changes discontinuously to the union of two 
adjacent regions of the sort just discussed.) 

On the other hand, consider the group Sa of rotational symmetries 
of the regular hexagon, ga , of order 6, consists of a 2 X 2 matrix rep- 
resenting a rotation of 60° in the plane along with the distinct powers 
of this matrix. Any 60° arc of the unit circle is a fundamental region for 
this group. Codes {6, 2} generated by Sa are equivalent for all choices 
of the initial vector X. 

An example illustratmg a partly determined fundamental region is 
obtained by considering the pui-e rotational symmetries of a cube 
in three dimensions. We imagine the cube centered at the origin and 
inscribed in a unit sphere. We speak in terms of the operations on the 
cube rather than in terms of the 3 X 3 matrices which describe these 
operations. Qg , a group of order 24, consists of rotations of the cube 
by 120° around the body diagonals, of rotations by 90° about axes 
through the origin and centers of faces and of rotations of ISC'* about 
axes through the midpomts of edges and the origin. One axis of each 
kind is shown on Fig. 1. In discussing the fundamental region of Qa 
and codes generated by Sa , it is convenient to speak of points on the 
cube, rather than on the circumscribed unit sphere. It is to be xmderstood 




Fig. 1 — Example of partly-determined fundamental region. 
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then that when a point on the cube is mentioned it is really the cor- 
responding point on the sphere obtained by projecting along a radius 
that is under discussion. 

The vertices of the cube, the centers of faces and the midpoints of 
edges must all lie in boundaries of fundamental regions, for these points 
are on axes of rotation of 93 • For example, a point distance e from a 
vertex of the cube has two nearbj' equivalent points forming an equi- 
lateral triangle with the vertex at the center of the triangle. These 
three points cannot all lie in the interior of one fundamental region. 
The cube vertex therefore cannot be an interior point of a fundamental 
region. In fact at least 3 fundamental regions must meet at each vertex, 
at least 4 at each face center and at least two at each edge midpoint. 
Cube vertices and face centers must therefore be vertices of fundamental 
regions. Now all vertices of the cube are equivalent under Qa as are all 
face centers and all edge midpoints; no two of these three types of 
points are equivalent. A fundamental region of S3 must therefore con- 
tain at least one cube vertex and one face center among its vertices and 
at least one cube edge midpoint along its boundary. 

Two distinct types of fundamental regions for Qg bounded by hyper- 
planes (great circles on the sphere) are shown in Fig. 1. Region AEFG 
is bounded by four hyperplanes. Edge midpoints are vertices of this 
type or region. Four fundamental regions surround each face center 
and each edge midpoint: three surround each cube vertex. Kegion 
ABCD is bounded by only three hyperplanes. Edge midpoints are 
no longer vertices of the fundamental region. Eight regions meet at 
each face center. The fundamental region ABCD corresponds to the 
maximum likelihood region of a group code having an initial vector 
(and hence all vectors) pass through a cube edge: region AEFG results 
when the initial vector passes through a face diagonal. All other positions 
of the initial vector give maximum likelihood regions that are funda- 
mental regions bounded by four hyperplanes but not congruent to 
AEFG. 

Ss is the irreducible representation of the symmetric group on four 
letters derived from the Young tableau^^ associated with the partition 
(2, 1, 1). The irreducible representation belonging to the partition (3, 1) 
is also three dimensional. It is equivalent to the group of synmietries 
of the regular tetrahedron and can be generated by reflections in planes 
through the centroid of the tetrahedron and its edges. The fundamental 
region here is completely determined. It is bounded by three of these 
generating reflection planes. Maximization of nearest neighbor distance 
for a {24, 3) generated by this group can be easily accomphshed by 
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choosing the initial vector equidistant from the three bounding planes 
of the fundamental region. 

jNlore generally, Coxeter^^ has shown that if a real-irreducible finite 
group oi n X n orthogonal matrices is generated by reflections, the 
fundamental region is completely determined, and in fact the region is 
bounded by n hj^ierplanes. Indeed, Coxeter has enumerated all possible 
groups of this sort. In dimensions n greater than 8, there are only three 
such groups, called by him A„, B„ , and C„ of order (n + 1)!, 2""^n!, and 
2"n!, respectively. These groups generate permutation modulation 
codes'^ — A„ generates Variant I codes, B„ generates Variant II codes 
with ^1 = 0, and C„ generates Variant II codes with mi ^ 0. The various 
permutation modulation codes are obtained by choosing the initial 
vector to lie in boundaries of various dimensionality of the fundamental 
regions of these groups. 

Returning to the general case (when g is not generated by reflections), 
the real eigenvectors of the 0; with eigenvalue unity serve to determine 
landmarks of the fundamental region. Such an eigenvector must lie in 
the boundary of the region. If 0; has I such eigenvectors, their span is 
an ^-dimensional boundary of the fundamental region. The situation 
has been studied by Robinson^* in some detail, but no simple method 
of classifying the possible regions is available. 

V. THE DIRECT SUM 

Since any group code is equivalent to the weighted direct sum of codes 
generated by real-irreducible representations of a group, it is natural 
to investigate the relationship between interword distances in the sum 
code and the corresponding distances in the summand codes. 

Let 9 = Ai , ^2 , ■ ■ ■ , Aj be a finite group of order g with A, the 
identity. Let -D'(A) and D'^(A) be two real-irreducible representations 
of 9 by real orthogonal matrices of dimensions Ij and h respectively. 
Let X, = /)'(A.)X, andYi = D\A,)Y, i = 1,2, ■ ■ ■ , ghe group codes 
generated by D' and -D^ (Neither code need have g distinct vectors.) 
The du^ct sum code with weights Xi and X2 has vectors 

Z, - KX, © X^Y, i= 1,2, •■- ,g (10) 

Xf -K X^ - 1, < X, , Xa < 1 

of I = li -^ I2 components. We seek to choose the weights so that the 
nearest neighbor distance, d, for the sum code Z is a maximum. 

Let at = d^(X.- , Xi) and ^, = d^(Y, , Yi) be the squared distance 
from the code word generated by A.- to the initial vector in the two codes, 
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i ^ 1,2, ■ ■ ■ , (/, respectively. For the sum code we have 

since the subspaces containing the X code and the Y code are orthogonal. 
The deiired maximum nearest neighbor distance is thus 



d^ = max min [(1 — '\)ai + X)5,-] 



(11) 



where we have set X = Xa . The situation is illustrated in Fig. 2. Here we 
have taken ^2 ^ ag ^ • ■ • ^ a„ which we can do without loss of general- 
ity since this is mei-ely a matter of giving names to the group elements. 
The bracketed expression on the right of equation (11) is plotted as the 
line segment with ordinate a; at X = and ordinate /S,- at X = 1. We 
seek the highest point on the bottom boundary of this collection of 
lines, point P in Fig. 2. 

Now any of the vectors Y,- , i = 1,2, ■ • ■ , g, not justYi , would serve 
to generate the Y code. We can seek a further maximization of the nearest 
neighbor distance (11) for the Z code by choice of the vector from the 
Y code to be called Yi . Stated otherwise, for the initial vector of the Z 
code we choose a particular vector Xi from the X code and to this we 
can add (directly) any of the vectors of the Y code. Now replacing Yi 
by Yi merely amounts to permuting the subscripts on the /3i of Fig. 2. 
The subscript i is replaced by k where AiAi = A^ . To combine the 
two codes to get the largest nearest neighbor distance, we must further 




Fig. 2 — Maximum nearest neighbor distance. 



588 THE BELL SYSTEM TECHNICAL JOUHNAL, APRIL 1968 

maximize (11) over permutations of the 0's corresponding to left 
translations of the group. 

The maximization just considered was with respect to the manner of 
combining the two summand codes. There remains the matter of choos- 
ing Xi and Yi to further increase (11). At first it might be thought 
that these vectors should be chosen to maximize the nearest neighbor 
distance in each of the summand codes. That this is not necessarily so 
can be seen from Fig. 2. Choosing X^ to increase the nearest neighbor 
distance in the code generated by Z>^ would cause oia to increase. The 
line connecting aa and 02 on the figure would move up. However, this 
change of Xi might cause at to decrease by a larger amount so that 
point P on the figure moves downward. The situation is complicated. 

The relationship between the maximum likelihood region for the 
sum code and the corresponding regions for the constituent codes is 
even more complicated in general. Let (R be the region belonging to 
Zi of equation (10) and let sC and Cd^ be corresponding regions for Xi and 
Yi in the summand codes. We -write Z = AjX + XzY for a general point in 
the space of the direct sum representation where X and Y lie in the 
respective invariant subspaces of the summand codes. A point will lie 
in CR then if | Z - Z, | ^ | Z - Z,- | for i - 2, 3, ■ ■ ■ , g, or what is the 
same, if 

\ld\X, XO + \id\Y, YO S A^d^X, X,) + \ld\Y, Y,) 

for i = 2, 3, ■■• ,g. Thus if X e fft' and Y tdC then Z e (R, but the con- 
verse is not necessarily so in general. 

A special case in which the converse holds is the following. It may 
happen that both the X code and the Y code have fewer than g distinct 
vectors. In the direct sum code (10) it may happen that each distinct 
vector of the Y code is paired at least once with each distinct vector 
of the X code. (9 must be homeomorphic to the direct product of two 
groups.) In this case Qi is the cartesian product of the two regions (R^ 
and 6i^. The probability of no error for the sum code is given by Q> = 
QlMQliK) where the factors are the probabilities of no error for the 
separate scaled summand codes. The information rate (3) for the sum 
code in this case is the weighted sum of the rates for the constituent 
codes 

R = y i2, + y^2 ■ 

We are better off using the code with the larger rate uncombined. 
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VI. THE CONFIGimATION MATRIX 

Let Xj , X2 , ■ ■ ■ , X.u be a eollectioii of unit vectors spanning s„ . 
The configuration matrix of this code is the M by M matrk p whose 
elements pa = X, • X,- are the cosines of the angles between the words. 
Equivalent codes have identical configuration matrices except for a 
possible relabeling of rows and columns. This configuration matrix is 
real, symmetric, non-negative definite and of rank n. The diagonal 
elements are unity and the off-diagonal elements are of magnitude no 
greater than unity. 

Conversely, we have the following 

Lemma: Every real, symmetric, M by M non-negative definite matrix of 
rank n with diagonal elements unity and off-diagonal elements of magnitude 
less than unity is the configuration matrix of a code of M unit vectors that 
span S„ . 

The proof of this lemma follows readily from the fact that a real sym- 
metric M by M matrix p can be diagonalized by an orthogonal matrix 0, 
that is, OpO~ = A where, since p is non-negative definite and of rank n, 
A has n positive diagonal elements and all other elements are zero. 
Without loss of generality we can take the first n diagonal elements of 
A, say X,i = X,. ,i=l,2,---, n to be the positive ones. From p = 0"^AO, it 
follows that 

p,/ = 12o,,V\o,i\/K = x,-x, 

I u 

where X; is a vector of n components, the /xth component being -y/xJJ^t , 
i = 1, 2, ■ • • , M. We have now exhibited M unit 7i-vectors whose 
configuration matrix is the given matrix p. We need now only show that 
they span S„ . But we have written p = XX where X is the matrix of M 
columns and n rows whose iih. column is X,- . The tilde denotes trans- 
pose. Since the rank of a product of matrices is not greater than the 
smaller of the ranks of the factors, it follows that X must be of rank n, 
for if it were of rank less than n, so also would be p contrary to hypothe- 
sis. The X,- therefore span S„ . 

For group codes, the rows of the configuration matrix are all permuta- 
tions of the first row of the matrix as can be seen from Proposition 1. 
Indeed the structure of this matrbc is closely related to the multiphca- 
tion table of the group generating the code. Let the code vector X; = 
D(Ai)X, i = 1,2, ■ ■ ■ , Mhe generated by an orthogonal representation 
D of a group g mth elements A^ , A2 , • • • , A.^ . Here A^ is the identity 
and the code need not have M distinct vectors. Denote by fi(A,-) the 
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angle between X,- and X, . Then d(Aj') = e(^,), i = 1, 2, ■ ■ ■ , M and 
the configuration matrix of the code is found to be given by 

p,,. = cos 0(A7M,) 

i, 3 = 1,2, ••• , M. If pii < 1 for j > 1, then the code has M distinct 
vectors: if 1 = pu, = pi,-, = ■ ■ ■ = pi,-, with 1 = j'l < ;3 ■ • ■ < i/. 
and these are the only elements of value unity in the first row, then 
the code has M/h distinct vectors. 
Conversely, we have 

Theorem 1: Let xiA^) he a real-valued junction defined on the elements 
Ay,A3, ■■■ ,AmOJ a group g of order M. Let x(Ai) = 1, where Ai is the 
idmtitij of the group, and let xiA^) = xiAj'), j = I, 2, ■ ■ • , M. If the 
M by M matrix p with elements p,-,- = x{A~^^Ai) is non-negative definite 
and of rank n, then there exists a group code {AI' n\ generated by an n- 
dimensional orthogonal representation of g that has configuration matrix p. 
Here M' = M/h where h is the number of different values of j for which 
x(A,-) = 1. 

Proof: The proof follows easily from the lemma. We can find M unit 
vectors X^ (not necessarily distinct) that span S„ such that p,-,- = X^ ■ Xy . 
Without loss of generality we can suppose that X, , Xa , ■ ■ • , X„ are 
linearly independent. Now an « by n real matrix is determined by speci- 
fying its effect on n vectors that span its carrier space. For each ii = 
1, 2, • • ■ , M we determine the n by n matrix D(A^) by specifying its 
effect on Xi , ■•• , X„ , namely that D(A^)Xi = X;,,-,^) ,i = 1,2, ••■ ,n 
where A^A,=A,(,.,j . Now XrX.i = Pi^=x(A-'Ai)=x(A-'A;'A^Ai) = 
a;(A7(\..„,AH,.M)) = X,(i,„, -X,;,.,,, , so that i)(AJ preserves the angles 
between n vectors spanning its carrier space. It is easy then to show 
that D{A^) preserves the angle between any two vectors and hence is an 
orthogonal matrix. For j > n, 



x,= E 



CXihAh 



h"! 



for some set of a's. Using this representation and the orthogonality of 
Z)(^J,itisnoweasytoshowthatZ)(A^)Xi = X,t.-.„- for«=l, 2, ■■■ , M. 
The fact that Z> is a representation then follows readily. 

Theorem 1 permits an interesting reformulation of the problem of 
finding an [M, n] of largest nearest neighbor distance generated by a 
representation of g. Form the modified multiphcation table of g, — an 
M hy M array of group elements with A'^^A,- in the ith row and jth 
column. From this table we construct a symmetric M by M matrix p 
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by replacing the group identity An , say, by unity, by replacing both Ai 
and Ai^ by the variable Xi , A^ and A7^ by Xz , and so on. If 9 has 
exactly m self-reciprocal elements, there will heK = m — 1 -\- (g ~ m)/2 
variables in p. The condition that p be non-negative definite and of rank 
not greater than n obtained by conditioning certain minors of p gives 
rise to polynomial constraints in the variables x^ , ■ - ■ , a;^ . To find the 
code of largest nearest neighbor distance, we must minimize max; Xi 
subject to these constraints. 

We notice in closing this section that the configuration matrix of an 
{AI, n] generated by a group g of order M commutes with all the ma- 
trices of the regular representation of 9 (see the appendix) . Using Schur's 
lemma, one can then arrive at a canonical representation for configura- 
tion matrices that involves the irreducible representations of 9. But 
we do not pursue this topic further here. 

VU. SOME THEOREMS ON DISTANCES 

We now adopt the notation of the appendix. Let 9 be an abstract 
group of order g with elements E, A, B, ■ ■ • where E is the identity. 

Let D(E), D(A), • • ■ be a real-irreducible representation of g by n X n 
(real) orthogonal matrices. From an initial unit vector X = X^ the 
representation generates a code by X^ = D{R)Xr , R runs through 9. 
We denote the squared distance from X^ to Xg by ^"(Xh , X5). We 
have then 

cf{X^, , X) - 2 - 2 J2 D{A),^x,x,- 
• .1=1 

= ff (X^, , X;,) (12) 

for every R and A tQ. Here Xi , x^ , ■ ■ ■ , .r„ are the components of X. 
For codes generated from real-irreducible representations in this 
manner, a number of interesting distance sums are independent of the 
choice of the initial vector X. 

Theorem 2: Let D(R) he the matrices of a real- irreducible orthogonal repre- 
sentation 0} a group of order g. Let X/; ^ D{R)X. Ij D(R) is not the trivial 
one-dimensional representation D(R) = 1, then 

E d'{X, . X) ^ 2f7 

independent oj the unit vector X. 

This is really a special case of the more general 
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Theorem 3: For amj code generated from the initial unit vector X by a 
real-irreducible orthogonal representation D of Si 

fltS 

where 

M» = ^ E x(B") 
ffn Bt9 

is a constant independent of X. Here x(R) = Tr D{R) is the character of R 
in the representation. 

Proof: Consider the matrix 

A ^ E D{R-) = E D(R)D{R) ■ ■ ■ D(R) 

where there are m factors in the summand. Since the representation is 
by orthogonal matrices, D{R) = D"'(fi) = D{R-^) where the tilde 
denotes transpose. Thus 

A = E D(K-^) • • ■ DiR-') = A 

since as R runs through g so does R~\ The matrix A is thus symmetric. 

We next show that A commutes with all the matrices D{R). By a 

theorem quoted in the appendix we can then conclude that A = al 

where I is the unit matrix. To see that A commutes with D(R), consider 

AD(R) = J: D(S)-^'D{S)D{R) = J^ D(S)-'DiSR). 

Now set SR = T so that S = TR~\ Then 
AD{R) = E D(TR-T~'DiT) 

= E D{TR-')D{TR-') • • ■ D{TR-')D{T) 
= E D{T)D{R-'T)D{R~'T) ■ ■ ■ DiR-'T) 

TtS 

= E D(RU)D(Ur-' = D{R) E D(C/r = D(R)A 

where we have used the substitution U = R~^T. 
From equation (12) we have 

E rf'(X«-" , X) = 2^ - 2 E ^i^i E ^(K"*)..' 



= 2^-2 E Xi^iAii = 2{g - a) 



■".1=1 
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by the diagonal property of A just established. To find a consider the 
trace of A, We have 

Tr^ =Tra/ = an = E Tr Z)(72"') = Ex(^'"). 

The theorem then follows. 

To establish Theorem 2, notice that for the trivial representation 
U'(fi) = 1, we have x{K) = 1. For the character xC^) of any other 
nonoquivalent real-irreducible representation we then have 

5:x'(ff)x{i2) = Ex(fi) = o 

by the orthogonality relations (appendix). Using this fact and setting 
wi = 1 in Theorem 3 yields Theorem 2. 

Theorem 4: Let Q be a class of n^ elements oj Q with character x(C)- ^or 
any code generated jrom the initial unit vector X by a real-irreducible 
orthogonal representation D oj Q, 

Zd\X,,X) =2nll -^x(e)) (13) 

Kits \ 7i / 

independent oj the unit vector X. 
Prooj: 

E (/^(X« , X) = 2n. - 2 E x^x,. D D(fl)„. . (14) 

RrC fftC 

Now consider the matrix 
B - i; D-'iR) = ^ E D^SRS^') = - E D"{S)D''{R)D''{S-') 

si.c d s,g 9 scs 

where D''(ff) is an irreducible (over the complex field) representation of 
dimension m of Q. Now B commutes with all the matrices of D" since 

BD'-{T) = - E D"{S)D"{R)D"{S-'T) 
9 .sis 

= ^ E I>''{TU-')D"{R)D\U) - Z)''(T)B 

where we have set S~^T = f/. By Schur's lemma, B = kl where / is 
the m by m unit matrix. Taking traces we have 

JrB = Tr E ^''(^) = n^X^i^) = Tr kl = km 
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SO that 

B= El>"(^)-^x''(e)/. 

p , ra III, 



(15) 



If now the real-irreducible orthogonal representation D is also irre- 
ducible, by equation (15) the inner sum in (14) is (n,/7i)x(e)5,.,- and the 
theorem (13) follows at once. 

Suppose now that D is not irreducible. Then (see appendix) Z> is 
equivalent to an orthogonal representation of the form 



D'{R) = 



V{R) V(R) 
[-V"iR) U"{R)] 



(16) 



where D"(K) = ViR) -H iViR) is an irreducible representation by 
unitary matrices and U° and V" are real and of dimension m where 
n = 2m. We can suppose the D of equation (14) to be of the form (16). 
Now let 



-S = E D'iR) 



and set 



U = 



V^ 



/ il 

[il I 



where as before I is the m by m unit matrix. One then finds by direct 
computation that 

D°(fl) 

D''{R)*_ 

x"(e)7 
x"{e)*n 



u-'m = z 



m 



= H 



where the middle equality follows from equation (15). Now let x"(C) = 
/I + iv with M and v real. Direct computation gives 



n = UHU'' = ^ 
m 



nl vl 

[-vl nil 



(17) 



The right of (14) is 



2«. - 2 E ^ii^i^i 
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and using (17) this becomes 
2n, 



2n, -^ME.r?-2«jl-^ ■ 

VI \ m/ 

From equation (16), however, x(<3) = 2m, so that (13) then follows 
and the theorem is proved in all cases. 

Since every group code can be thought of as the direct sum of codes 
generated by real-irreducible representations, and since squared distance 
in the sum code is the sum of squared distances in the separate codes. 
Theorems 2, 3, and 4 have ready analogues for all group codes. For 
example, if a group code does not contain the identity representation, 
then 

E d'{X, , X) = 2ff. 

ftiS 

Theorems 3 and 4 hold for group codes in general when x(K) is replaced 
by the weighted sum ^ \^x'(^) of the characters of the constituent 
real-irreducible codes. 

Another theorem of interest concerning codes generated from any 
group of orthogonal matrices arises from the fact (12) that d^(X^ , X) = 
d^i^RA , Xn). Let there be a point of the code distant d from the point 
Xe . Starting from Xg , we imagine moving from word to word of the 
code restricting our moves so that from any word we can move only to a 
word distant d away. We shall call the collection of w^ords that can be 
reached from Xjj in this manner "a d chain starting from Xg". Xg is to be 
included in this chain. 

Theorem 5: Lei the words of a d chain starting from Xb be X^ , X^, , 
Xx, , ■ ■ ■ Xa^ . Then the group elements E, A^ , A2 , ■ • • , A/, jorm a 
subgroup 3C 0/ 9- The group elements whose corresponding words are dis- 
tant d jrom Xe jorni a set 0} generators for 3C. 7/ 30 is a proper subgroup of 9, 
then from any word corresponding to a group element not in 3C, a new d 
chain may be formed and the group elements corresponding to the points of 
this new d chain will form a coset of X. 

jProo/: Suppose all the points distant rf from Xgare X^, , X^, , • • ■ , Xa„ • 
Let us construct a table of group elements in the following manner. 
The fu-st row \s E, Ai , A2 , •■■ , A^. The K + 1st row of the table is 
formed from the preceding K rows as follows. We examine the elements 
of the table in order, reading from left to right in the first row, then from 
left to right in the second row, and so on. Let R be the first element 
arrived at in reading the first K rows that does not appear in the first 



596 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 19C8 

column, rows I, 2, ■ ■ ■ , K. The the K + 1st row is to be 

R, RA] , RA2 ] ■ ■ ■ , RAn • 
The table thus appears 

E, A, , A2 , A„. 

Ai J A-i f A.iA.2 J AiA,„ 

A2 , A2A1 , A2 , A2A„ 

Am I AmAi , A-^Az , Ani 

B, BA, , BA2 , BA„ 

R, RAi , RA2 , RA„ 

When ; rows have been written and every element in these j rows has 
appeared once in the first column the process is stopped and the table is 
considered complete. The table can have at most g rows. Now from 
d^(Xfl , Xb) = d'iXsR , X3), it follows that the words represented by 
the elements in the 2nd, 3rd, ■ • • , m + 1st columns of the Kth row are 
all distant d from the word represented by the element in the first column 
of the Kih row. Furthermore, these m words are all the words of the 
code that are distant d from the word represented by the element in the 
first column of the Kih. row. Thus the elements of the first column of 
the table give the points of the d chain starting from X^ . That these 
elements of the first column form a group 3C and that Ai , A2 , • • • , A^ 
are generators of 3C is clear from the method of constructing the table, 
for we have formed aU possible distinct products of the A's and listed 
the distinct elements thus obtained in the first column. Let X be a 
proper subgroup of 9 and let S be an element of g not in 3C. If we multiply 
every element in the above table by S, we obtain a new table giving 
all the points that can be reached from point Xs by steps of distance d. 
The first column of this table lists the points of the d chain starting 
from Xs and the corresponding elements are just the coset S3C of X. 

VIH. BINARY GROUP CODES 

The group codes (n, k) for the binary channel introduced in Ref. 21 
are group codes in the present sense. Each word of an (n, k) code is an 
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n-place binary sequence. Replace each zero by 1 and replace each 1 by 
— 1 in each word. Then write each word (a sequence of ±l's) as a 
diagonal n X n matrix. This collection of 2*^ n X w- orthogonal matrices 
forms an Abelian group (S,k that is isomorphic to the fc-fold direct product 
of the simple two element Abelian group. The matrices generate the 
code by operating on the n-vector (1, 1, 1, ■ ■ ■ , 1). The real-irreducible 
representations of this group are all one dimensional. There are 2* of 
them. The representation by n X n matrices just considered is already 
exhibited in reduced form as the direct sum of n of these real-irreducible 
representations. 

IX. CONCLUDING REMARKS 

The foregoing paragraphs outUne some of the theory of group codes 
for the Gaussian channel. The development of this subject is clearly 
incomplete: we have raised more questions than we have answered. 
Perhaps the outstanding problem is that of finding a tractable method 
of choosing the initial vector to maximize the nearest neighbor distance. 

There is a great abundance of groups of arbitrarily large order that 
can be examined from the point of generating group codes. The sym- 
metric group and the hyperoctahedral group appear most promising 
for initial investigation since their structure and irreducible representa- 
tions (which are all real) are comparatively well understood. 

APPENDIX 

Review of Group Representation Theory'^^ 

Let S be a finite group of order g with elements E, A, B, ■ ■ ■ . The 
letters R and S will be used for the general element of g and E will denote 
the identity of g. As i? runs through S, the distinct elements of the set 
RAR"^ are said to form a class of g. The elements A and B are said to 
belong to the same class of g if there exists an S such that A = SBS'^. 
g can be divided uniquely into a union of classes, no two classes con- 
taining a common element. The number of elements in a class of g is a 
divisor of g. 

If 3C is a subgroup of g and if 3C is of order /;, then h is a divisor of 
g and the number g/k is called the index of 3C under g. If, for every 
R in 3C, all elements of g in the same class as R are also contained in X, 
then 3C is said to be a self-conjugate subgroup of g. A subgroup 3C of g 
is said to be proper \( h < g. 

The matrices in what follows are assumed to have elements in the field 
of complex numbers. 
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If to every element R of a finite group 9 there corresponds an n by n 
nonsingular matrix D(R) and if D(R)DiS) = D{RS), the collection of 
matrices A = {D(7£), fi runs through 9) is said to form an n-dimensional 
representation of 9. The matrices of A form a group under matrix 
multiphcation. If the correspondence between the matrices of A and the 
elements of 9 is one-to-one, A is said to be a faithful representation of g. 
If for some R ^ S, DiR) = D(S), A is said to be an unfaithful repre- 
sentation of 9. The matrix D{E) is always the n by n unit matrbc. If a 
representation is unfaithful, the elements represented by D{E) form a 
self-conjugate subgroup of 9, say of order h, and to each matrbc of A 
correspond exactly h elements of 9. A contains g/h distinct matrices. 
If D(E), D{A), ■•• is an n dimensional representation of 9, so is 
MD{E)M~\ MD{A)M~\ ■ ■ • where M is any nonsingular n by n 
matrix. The two representations A and MAM"' are called equivalent. 
Every representation of a finite group is equivalent to a representation 
by unitary matrices. Henceforth we shall be concerned only with such 
unitary representations. 

A finite collection of n by « matrices Oi , O2 ,-■-, Ok is said to be 
reducible if there exists an n by n unitary matrix U such that for i = 
1, 2, ■ • • , K we have 

uo,u-' = 

where At is an i by Z matrix, B, is an n-l by n-l matrix, < I < n, C 
is an n-l by I matrix aU of whose elements are zero, and 7) is an Z by n-l 
matrbc all of whose elements are zero. It is assumed that I is independent 
of i. A collection of matrices that is not reducible is said to be irreducible. 
Every finite group has exactly as many nonequivalent irreducible 
representations as it has classes. lik , k , ■■ • , h are the dimensions of 
all the nonequivalent irreducible representations of 9, of order g, then 

1 

If WiR)^, is the element in the ^th row and Hh column of the matrix 
representing R in the Z„ -dimensional irreducible representation, a, of g, 
then 

X; D''{R),,D\R)t.,. = 5,,. S^^-g/L M, m', v, v' = I, 2, - ■ ■ , L . 

Here * means complex conjugate and 5 is the usual Kronecker symbol. 
If the matrices D^{R) form an l^ dimensional irreducible representation 



A, 
C 


D 
Bi 
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5Q9 



of 9 not equivalent to the representation a, then 

AtS 

^,u = 1,2, ■■■ ,L , m',^' = 1,2, ■-. ,/, . 

If D{R) is the n by n niatrLx representing R in the representation A, 
the trace of D(R), namely 

x{R) = f: D(R\, , 

is called the character of fi in the representation A. li R and S are in 
the same class of Q, then x(R) = xiS), for any representation of g. 
The characters of the irreducible representations a and /3 of g satisfy 
the orthogonahty conditions 

J:x\R)AR)* =^ gs.s. 

ff.S 

Here 5^^ is unity if a and /3 are equivalent representations and is zero 
otherwise. 

Let A be any representation of g with character x(R)- Let the char- 
acters of the irreducible representations of g be x'(^)) j = I, 2, ■ • • , c 
where c is the number of nonequivalent irreducible representations of 
g (= number of classes of 9). Then xiR) may be ^vritten uniquely in the 
form 

x{R) = Ea,xW, allying, 

; = 1 

where the a, are nonnegative integers independent of R. In fact, 

«, -IEx{R)xKR)*. 

The representation A is said to contain the u-reducible representation 
; a, times and there exists a unitary matrix U independent of R such 
that 



UD(R)U" = 



D'(R) ■ - . 
D'(R) - ■ ■ 

D\R) 



all fi in g 
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where D\R), D'\R), D\R) etc., are matrices of the ith., jth, kth, etc., 
irreducible representation of g, and stands for the appropriate matrix 
with all elements zero. The jih irreducible representation will occur 
exactly a,- times among D'{R), D'iR), D'(fl) and so on. 

Every group Q possesses a faithful representation, called the regular 
representation r, that consists oi ghy g permutation matrices. The rows 
and columns of these matrices can be labelled by the elements of 9. The 
entry in row R and colunm S of the matrix representing T is unity if 
R = TS and is zero otherwise. The regular representation is reducible: 
it contains the irreducible representation D" exactly /<. times, a = 
1, 2, . . . , c. 

Let D'{R) and D"(R), R runs through g, be irreducible representations 
of g of dimension d' and d" respectively. Let the matrix H satisfy 
D'(R)H = HD"{R) for all i2 in 9. Then either H is the zero matrix or 
H is square and nonsingular so that d' = d", and the two representations 
are equivalent. A matrix that commutes with all the matrices of an 
irreducible representation of 9 is a multiple of the unit matrix. These 
statements are known as Schur's lemma. 

Much of the foregoing remains valid with minor modifications when 
the number field in question is the real rather than the complex numbers. 
One easily finds that every real representation of a finite group is 
equivalent (over the reals) to a representation by orthogonal matrices. 
The only real symmetric matrix that commutes with all the matrices 
of a real-irreducible representation is a multiple of the unit matrix. 
If D"{R) and D^{R) are nonequivalent real-irreducible representations 
by real orthogonal matrices, respectively of dimension i„ and l^ , then 



2:i>"CK)..-0'(^).>' = 0. 



AeS 



ii,v = 1,2, ■ ■ ■ ,la n',1-' = 1,2, ■ • • , Ig , 

= 2 5,,, 5...g/L , 

11, V, n' , v' ^ \,2, ■ ■ ■ l„ . 



E [D''{R),,D"{R),.r + D''{R),..D''{R),::\ = 2 5,,, 5...g/K , 



For the characters one has 

Y.x"{R)x\R) -0 

if the representations a and ^ are not equivalent, while 
E \x'{R)x'{R) + x*"(R')] = 2f;. 
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Every real-irreducible representation that is reducible (over the coinplex 
numbers) is equivalent to the direct sum of an irreducible representation 
and its complex conjugate. If the irreducible unitary representation 
D(R) = U(R) + iV(R), with U and V real, is not equivalent to a real 
orthogonal representation, then 

V{R) U(R)J ^^^^ 

is a real-irreducible representation by real orthogonal matrices. 
For an irreducible representation D{R) with character x(^), the sum 

/^ - ^ Z xiR') 

can have only one of the three different values 0, dzl. U h ^ I, D{R) is 
equivalent to a representation by real orthogonal matrices. If h = —1, 
the representation D is equivalent to its complex conjugate, but is not 
equivalent to a real representation. A real-irreducible representation 
can be made from each irreducible representation D having h = — 1 by 
forming real matrices of the form (IS), where U and V are the real and 
imaginary parts of D. Finally, if /i = 0, D is not equivalent to its com- 
plex conjugate and is not equivalent to a real representation. Non- 
equivalent in-educible representations for which h = occur then in 
complex conjugate pairs. Each such pair gives rise to a single real- 
irreducible representation through the recipe (18). Thus, finally, if h 
has the value for exactly 2p of the c nonequivalent irreducible repre- 
sentations of g, then g has exactly c — p nonequivalent real-irreducible 
representations. 
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